Edge-based resource spin-up for cloud computing

ABSTRACT

Aspects of the present invention include distributing new resources closer to end-users which are making increased demands by spinning-up additional virtualized instances (as part of a cloud provisioning) within servers that are physically near to the network equipment (i.e., web servers, switches, routers, load balancers) that are receiving the requests.

RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.13/245,601, filed Sep. 26, 2011, entitled “EDGE-BASED RESOURCE SPIN-UPFOR CLOUD COMPUTING” which is related to U.S. patent application Ser.No. 13/245,582, filed Sep. 26, 2011, entitled “DYNAMIC ROUTE REQUESTSFOR MULTIPLE CLOUDS”, which are incorporated by reference in theirentirety for any and all purposes.

BACKGROUND

Presently, compute resources (i.e., applications, etc.) within a cloudprovider's network are spun-up in a cluster (e.g., servers which areaggregated in a centralized location, a datacenter, etc.). All requestsare load-balanced back to that cluster. Unfortunately, such animplementation does not necessarily provide the best performance orexperience for end users who may, for example, be located far away fromthe centralized cluster.

This problem is further compounded by the fact that applicationsprovided within the “cloud” are becoming more robust and requireadditional resources and computing power as well as faster responsetimes. Accordingly, the computations being preformed over the web arebecoming increasingly more intensive. As such, with the centralizedcluster approach, many of these computations are being routed away fromthe user which adds to or even causes delays and an unacceptable userexperience.

One example of a current implementation is illustrated by method 100 ofFIG. 1. A data center 105 includes a compute platform 110 which is incommunication with devices which produce user requests 115. As such,user requests 115 are received by the data center 105, which includesthe cloud resources. As requests increase, software and services withinthe data center 105 are spun-up by additional cloud resources using thecompute platform 110. The distance between the compute platform 110 andthe user requests 115 may be great, and therefore, responsiveness anduser experience are diminished greatly.

Furthermore, in the current cloud-service environments, customers mustdeploy their applications to a single cloud, and utilize the elasticityof the cloud to determine additional resources and spin those upaccordingly within the cloud environment. Unfortunately, if the cloudprovider is experiencing difficulties (either regionally or globally),the customer has no way to re-route requests to another cloud, and thusperformance is dramatically impacted. Thus, for at least these reasons,improvements in the art are needed.

BRIEF SUMMARY

In one embodiment, aspects of the present invention distribute newresources closer to end-users which are requesting the resource. Assuch, additional virtualized instances (as part of a cloud provisioning)are spun-up within servers that are physically near to the networkequipment (i.e., web servers, switches, routers, load balancers) whichare receiving the requests. Accordingly, by moving computationalresources closer to the requesting users in cloud computingenvironments, the user experience is significantly enhanced.

Further areas of applicability of the present disclosure will becomeapparent from the detailed description provided hereinafter. It shouldbe understood that the detailed description and specific examples, whileindicating various embodiments, are intended for purposes ofillustration only and are not intended to necessarily limit the scope ofthe disclosure.

Further aspects of the present invention include dynamically routingrequests for applications to one of multiple cloud computingenvironments. Alternatively, the method may dynamically route anapplication request to an application that is hosted in multiple clouds(deployed within a management application) based upon a specifiedcriteria. In one embodiment, the routing of requests for the applicationto a specific cloud in which the application is deployed may be basedupon a criteria(s) that the application owner specifies. This mayprovide the application owner an ability to positively affect quality ofservice (QoS) for application delivery, ensure uninterrupted access tothe application in the event of failure by one or more clouds, andprovide more efficient application performance.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a system for implementing cloud computing.

FIG. 2 shows a system for implementing edge-based resource spin-up forcloud computing.

FIG. 3 shows a method of implementing edge-based resource spin-up forcloud computing.

FIGS. 4A-4D show systems for implementing edge-based resource spin-upfor cloud computing.

FIGS. 5A-5D show methods of implementing dynamic route requests formultiple clouds.

FIGS. 6A and 6B show systems for implementing dynamic route requests formultiple clouds.

FIG. 7 shows an embodiment of a content distribution system.

FIG. 8 shows an embodiment of a computer system.

In the figures, similar components and/or features may have the samereference label. In some cases, components of the same type areidentified by following a first reference label with a dash and a secondreference label that further distinguishes among the similar components.If only the first reference label is used, the description is applicableto any of the similar components designated by the first referencelabel.

DETAILED DESCRIPTION OF EMBODIMENTS

The ensuing description provides preferred exemplary embodiment(s) only,and such preferred exemplary embodiments are not intended to limit thescope or applicability of the present invention. Rather, the ensuingdescription will enable those who are skilled in the art to implementsuch preferred exemplary embodiment(s). Persons of skill in the art willrecognize that various changes may be made in the function andarrangement of elements without departing from the spirit and scope ofthe invention as set forth in the appended claims.

FIG. 2 shows a system for implementing edge-based resource spin-up forcloud computing, in accordance with one embodiment of the presentinvention. In one embodiment, edge-based resource spin-up includescarrying out computational activities within a cloud computingenvironment closer to the end user. As such, an increase inresponsiveness as well as a more efficient use of resources is realized.System 200 includes a data center 205 a and 205 b. In one embodiment,data centers 205 may be a facility used to house computer systems andassociated components, such as telecommunications, networking systems,storage systems, etc. Furthermore, the data centers 205 may also bedesignated as points of presence (PoPs).

In one embodiment, the data centers 205 a and 205 b may include edgeservers 210 a and 210 b, respectively. Further, edge servers 210 a and210 b may include compute platforms 215 a and 215 b, respectively. Itshould be noted that one skilled in the art would conclude that anynumber of data centers, edge serves, and/or compute platforms may beincluded, and only two of each are shown for ease of explanation andillustration.

In a further embodiment, system 200 may include a load balancer 220 incommunication with both data centers 205 a and 205 b, as well as userdevices issuing user requests 225 a and 225 b. In a cloud computingenvironment such as the one depicted in system 200, many user requestsmay be received, and proper allocation and division of cloud resourcesshould be allocated to handle the requests. Furthermore, many of therequests are time sensitive and latency sensitive (i.e., UI intensiveapplications, computation intensive applications, etc.), so ensuringfast response times to requests can be important. As such, in theconfirmation of system 200, the load balancer 220 is configured todetermine the “fastest” responding edge server/compute platform todirect the request. In one embodiment, fastest response time means theedge server closest physically to the requesting user device.Alternatively, fastest may mean the edge server with the lowest latencyrelative to the requesting device. In some instances, the closest andthe lowest latency edge server may be the same server, but not always.For example, if the physically closest edge server is experiencing aheavy load of traffic and requests, the response time and/or networklatency of the server may outweigh the physically close proximity to therequesting device.

In other words, the load balancer 220 is configured to ensure that theneeded resources to respond to the user requests 225 a and 225 b arerouted to the edge servers 210 a and 201 b which will provide thefastest response time for the request, which in many cases will be theedge server which is in the closest proximity to the requesting userdevice.

In one example, two groups of users make requests from two differentgeographical locations. The load balancer 220 then receives the requestsand, based on the location of the request, distributes the request tothe data center 205 a or 205 b closest to the user (alternatively, therequest may be routed to the data center which will provide the fasterresponse time). Once the request is routed, it is received by a“localized cloud instance” which is a de-centralized cloud computingenvironment with resources spun-up as physically close to the requestingdevice as possible. In one embodiment, such localized resources may besynchronized around the network to ensure that requests come to onelocalized cluster are treated in the same manner as other requests.Then, based on the request load that is delivered to that “localizedcloud instance,” resources are spun-up in that locality based upondemand (i.e., subsequent user requests).

FIG. 3 shows a method 300 of implementing edge-based resource spin-upfor cloud computing, in accordance with one embodiment of the presentinvention. At process block 305, a request for data or a service may bereceived at an edge server from a user device. In one embodiment, theclosest edge server to the requesting device may be determined by usingan enhanced anycast methodology. Accordingly, the edge server whichprovides the fastest response time relative to the requesting userdevice is selected.

In one embodiment, the request may be for an application, such as anenterprise application, a media application, etc. Alternatively, therequest may be for data, such a video file, a music file, a document,etc. Each request may have associated information sent with the requestwhich identifies the application and/or data used to service therequest. The identification information may be embedded or attached tothe request.

Furthermore, at process block 310, the edge server may extract theidentification information. Then, based on the information, the edgeserver can identify the application/service used to process the request(process block 315). For example, the identification information mayspecifically identify the application by name or some other identifier,or alternatively the information may include an application type, etc.

Further, the selected edge server may be in communication with one ormore compute platforms, which may be co-located or remotely-located withthe edge server. Additionally, each of the compute platforms may haveone or more containers running which provide a virtual construct forallocating resources. In one embodiment, these containers may be a typeof virtualized resource which is different from a virtualized instance,such as elastic computing cloud (EC2). The containers are thenconfigured to execute and maintain applications needed to service theuser requests. Hence, at decision block 320, a determination is madewhether a container maintained by a compute platform in communicationwith the selected edge server is running (or capable of running) theapplication necessary for servicing the user request. In one embodiment,all of the edge-based compute platforms may include the “DNA” forrunning an application (e.g., an XML dataset that specifies instructionsfor each application to be run in a container), and the determinationfor being able to run the application based on the current levels ofutilization. As such, the allocation of the compute platform becomes apredictive determination. In one embodiment, a compute platform iscapable of running the application if the compute platform hassufficient unused resources, if the necessary application is loaded onthe compute platform, etc.

If the application is not running on any of the containers within thecompute platforms, then at process block 330, an available computeplatform (or on other words, a compute platform which has availableresources) is identified. Accordingly, it may not matter if theapplication is not currently running, as the application can be spun up;availability can be based on either a currently running application orthe necessary capacity to support the application running, which couldthen be translated to actually spinning up a container, on demand, tosupport the requests. Then, one or more containers are spun-up by theidentified compute platform to run the identified application or service(process block 335).

Alternatively, if there is a container identified as running theapplication, then a determination is made whether the container hassufficient resources to handle the increased load of the new request(decision block 325). If the container does not have sufficientresources to handle the increased load, then at process block 335, acontainer (or containers) may be spun-up to run the identifiedapplication. Alternatively, if the container has sufficient resources tohandle the increased load, then at process block 340, the request isrouted to the compute platform with the container already running theidentified application. As such, the load is effectively balanced to thecompute platform and container with available resources from the edgeserver with the closest physical proximity to the requesting device;thus, providing the most efficient user experience.

One example of an implementation of method 300 may be performed for theMediaTag™ application. In one embodiment, a user may click on alink/file that the user desires to purchase. The file includes anassociated cookie which is used to point the request to the MediaTagapplication. The application makes a request of the cookie which hasbeen stored on the user's machine by the website providing the musicdownload; MediaTag then takes the cookie, explodes it, and carries outcomputational activity against the results. The edge server then uponreceiving the request interprets the tag and identifies a computeplatform which is capable of spinning-up resources for the MediaTagapplication. Alternatively, the determination may be based solely ongeography—the closest POP with resources; there is sometimes a tradeoffbetween locality and capacity—as a system may chose to actually go to amore distant compute resource to carry out my request because thelatency of serving the response is actually less than the latency causedin the local edge by the lack of capacity.

Then, the compute platform spins-up a container running the MediaTagapplication. The MediaTag application then creates a unique file basedon the request (the file may include identification information, such asthe username of the requester, the origination location, etc.). Again,alternatively, the choice may be based on both proximity and the currentutilization level of that current proximal location; there is atradeoff. Then, a response to the request is sent to the user (processblock 345).

This entire process is implemented using the edge-based cloud computingsolution of the present invention. At each step of the execution of theMediTag application, resources and servers are chosen based on theirphysical proximity to the requesting user device, thus increasing theefficiency and executing time of the MediaTag application. Otherapplications may be implemented in the same or similar way utilizingmethod 300.

Referring next to FIG. 4A, a system 400 for implementing edge-basedresource spin-up for cloud computing is shown, in accordance withembodiments of the present invention. The system 400 may include a userdevice 405. In one embodiment, the user device 405 may be a mobiledevice, a cellular device, a SmartPhone, a mobile computing platform, auser terminal, etc. The user device 405 may be configured to sendrequests and access data, services, and applications. Further, the userdevice 405 may be in communication with a cloud computing network asshown in system 400.

In one embodiment, the user device 405 may be in communication with apoint of presence (PoP) 410. PoP 410 may be configured as an accesspoint to the Internet 430, a physical location that houses servers,routers, ATM switches, digital/analog call aggregators, etc. Further,PoP 410 may be either part of the facilities of a telecommunicationsprovider that the Internet service provider (ISP) rents or a locationseparate from the telecommunications provider. Generally, PoPs are alsolocated at Internet exchange points and collocation centers.

An edge server 415 may be located within PoP 410. The edge server 415may be operated by a cloud computing provider, or the like. The edgeserver 415 may represent one of the cloud computing provider's closestconnection points to the Internet 430. As such, the edge server 415 isuniquely qualified to provide the fastest and most efficient service tothe user device 405, particularly with regard to spinning-up resourcesfor use in a cloud computing environment. In many implementations theremay be hundreds of edge servers ready to receive and process userrequests.

Accordingly, as requests are generated from user device 405 and routedto edge server 415 via PoP 410, the edge server 415, in communicationwith a compute platform 420, may direct the compute platform 420 tohandle the requests. For example, edge server 415 may direct computeplatform 420 to spin-up a container 420 a to handle the incomingrequest. In one embodiment, spinning-up container 420 a includesallocating and assigning the necessary resources and applications tohandle the request. For example, if the request is for application 420b, then an instance of application 420 b (e.g., MediaTag, video player,gaming application, etc.) will be initiated in container 420 a.Likewise, if it is determined that application 420 b requires X amountof processing power, memory allocation, hard drive space, etc., thenthese needed resources will also be allocated in container 420 a. Assuch, container 420 a is spun-up such that container 420 a is equippedto handle the request from user device 405.

In a further embodiment, the PoP 410 may be selected as being the“closest” PoP to the user device 405. In one embodiment, closest meansthe closest in physical proximity to the user device 405, which in turnprovides the fastest response time to requests, thus enhancing the cloudcomputing experience. For example, in a central server cloud computingconfiguration, computations are routed away from the user device;however, in an edge-based cloud computing environment as in system 400,the computations are performed as close as possible to the user device405. As such, rendering of cloud applications can be done withoutdiminishing the experience (i.e., the application can be rendered asthough the application is run “locally” on the user's device, or in alocal area network or the like). This may be particularly important withregard to mobile users in that—as the user moves, so too may the“closest” available edge server “move”.

Furthermore, such a cloud computing configuration as in system 400 canprovide a more efficient use of resources. For example, instead ofimplementing a large expensive resource intensive centralized cloudcomputing platform, the de-centralized model allows for resources to bespun-up in order to handle specific user requests. Furthermore, system400 (additionally, systems 401-403) provides a scalable solution, suchthat as additional requests are received by compute platform 420, theplatform can direct additional containers to be spun-up to dynamicallyhandle the increased load. In other words, the containers allow fordynamically creating instances of the systems' operating system whichhas been “tuned” for a specific purpose. Therefore, the necessaryresources are provided in response to the received requests, and theresources are provided at the closest location to the requesting device.

Alternatively, other factors can be considered when determining theappropriate edge server to route the user device 405's request. Forexample, “effective latency” or “effective distance” may be considered.In one embodiment, effective latency or distance may be defined as theaccrual speed of a response to a user device request. For example, edgeserver 415 may be physically closer to user device 405, but edge server415 may be heavily congested. Thus, edge server X (which is physicallyfurther from user device 405) may have a better effective distance orlatency, and may ultimately be selected to process the request, despiteits distance from user device 405. Similarly, outages and other issuesmay be considered when determining which edge serve will actually (oreffectively) provide the fastest response time and ultimately the mostdesirable user experience. Such a cloud computing environment uniquelyprovides what a centralized cloud computing environment is unable toprovide: scalability, efficiency, and faster response times.

Additionally, configuration files (or the like) may be used to determinethe edge server and/or the compute platform to handle certain userrequests. For example, a certain edge server may be closest to the userdevice 405, but because the edge server does not have access to therequested application or other resource, a further edge server may needto be used. Therefore, the configuration file may provide suchdesignation and mappings, such that requests are routed to edge serversand compute platforms that are actually equipped to handle the request.Additionally, the configuration files may also provide an accounting ofthe physical as well as the virtual resources available to each edgeserver, which can assist in routing decisions by not overloading edgeservers above their resource capability capacity, etc.

An additional advantage of edge-based cloud computing may be thatrequests are able to be routed using URLs. URLs uniquely allow forinformation to be appended to the URL which can provide the necessaryinformation to the edge server for more efficient routing and resourceallocation. In addition, URL-based routing enables a variety of systems(e.g., anything capable of dealing with HTTP) the ability to forward therequest along. This makes for a very flexible application architectureand a distributed computing environment in that individual applicationcomponents, all making URL (i.e., HTTP-based) requests, can be completedfrom different compute resources, not necessarily all the sameresource—the resources used for these requests can be fanned out.

FIG. 4B shows an alternative embodiment of an edge-based cloud computingconfiguration. In one embodiment, system 401 may have the computeplatform 420 co-located with edge server 415 at PoP 410. Furthermore,multiple compute platforms 420 a, 420 b to 420 n may be provided. Assuch, the additional compute platforms may provide the edge server withaccess to additional resources in order to handle additional requests.Furthermore, since the compute platforms 420 a to 420 n are co-locatedwith the edge server 415 at the PoP 410, latency can be significantlyreduced. Accordingly, computations for user requests are pushed evencloser to the user device 405 originating the request. Accordingly, theedge is “super-charged” with readily available compute resources to meetspecific types of requests. In addition, new intelligence is added tothe edge to better route request traffic (i.e., URLS) to other edgeresources, different POPs, etc., depending upon performance and/oravailability factors that reflect customer preferences.

In a further embodiment, each of the compute platforms 420 a through 420n are capable of spinning-up multiple containers 422 a through 422 n.Thus, each of the containers 422 a through 422 n can also provideinstances of applications 423 a through 423 n. Accordingly, each computeplatform 420 can expand or shrink to effectively and efficientlyaccommodate an increase or decrease in user requests. The dynamic natureof resource allocation coupled with the relative closeness in proximityto the user device 405 provide for an optimal user experience in a cloudcomputing environment.

FIG. 4C shows another embodiment of an edge-based cloud computingenvironment. System 402 shows an alternative configuration in which thecompute platforms 420 a through 420 n are located at a compute server435, which may be remotely located from the edge server 415 and PoP 410.For example, since server space may be expensive within the PoP 410, itmay be economical to place the compute platforms at a location in closeproximity to the PoP 410 which is less expensive. As such, thediminished response time (which is minimal) may be outweighed by thereduced cost of non-PoP space (in particular, if the same edge resourcesare being utilized for other purposes (i.e., streaming)). Additionally,at the reduced cost of implementing compute server 435, thecomputational power at the edge server 415 can be significantlyincreased, and as such is able to handle an increased amount ofrequests; thus increasing the scalability and efficiency of the cloudcomputing environment.

FIG. 4D shows a further embodiment of an edge-based cloud computingenvironment. In this embodiment, shown as system 403, instead of theedge server 415 being located at the PoP 410, a router (or the like) 412is located at the PoP 410. The router 412 may be configured to routerequests from the PoP 410 to the edge server 415. Then, the edge server415 can direct the requests to the appropriate compute platform 420within the compute server 435. In one embodiment, the compute server 435may be co-located with edge server 415, or alternatively the computeserver 435 may be remotely-located from the edge server 415.

Further aspects of this invention include dynamically routing requestsfor applications to one of multiple cloud computing environments.Alternatively, the method may dynamically route an application requestto an application that is hosted in multiple clouds (deployed within amanagement application) based upon a specified criteria. In oneembodiment, the routing of requests for the application to a specificcloud in which the application is deployed may be based upon acriteria(s) that the application owner specifies. This may provide theapplication owner an ability to positively affect quality of service(QoS) for application delivery, ensure uninterrupted access to theapplication in the event of failure by one or more clouds, and providemore efficient application performance.

As Web applications are becoming increasingly more complex and resourceintensive, (in some cases requiring multiple coded elements, multipledata stores, external and internal system integration, etc.), even a fewmilliseconds of latency between the user requesting an element of theapplication (via, for example, a URL) and the response to the user, cancause a user to utilize a competitors' offering and thereby materiallyimpact business for the Web application owner. In addition, there are avariety of factors that may impact (negatively or positively) theability for a specific cloud to respond favorably (based on, forexample, business rules) to a user request. This can include proximityof the cloud assets to the end user, peering relationships between thecloud service provider and ISPs on which users are accessing the cloudresources, etc. Thus, aspects of the present invention create a pictureof that responsiveness to eventually enable a dynamic adjustment ofbusiness rules based on analysis of the data provided as part of theoverall system.

One embodiment of the present invention may provide that a customersigns up for a “multi-cloud application deployment” which entailsprovisioning for a content delivery network (CDN) account (i.e.,providing HTTP service or the like), as well as enabling the customeraccess to a portal (or other web-based UI) that allows the customer tospecify the cloud-based locations of their applications, the URLs tothose applications, the business rules the customer wants theapplications to follow when shuttling requests to different clouds, etc.Each cloud that the customer specifies may require a unique hostnameprovided by the CDN.

Turning now to FIG. 5A, which illustrates that once the multi-cloudapplication deployment has been properly configured, method 500 may beexecuted. At process block 502, a request may be received by the enduser. This request may then be passed to the edge of the CDN via a CNAMEor designated hostname provided by the CDN to the customer thatconfigures their application URLs accordingly (process block 504). Atprocess block 506, the request may then be passed through a requestanalysis unit (or similar module) to gather metrics on the responseprovided by the application to which the request is being used. Forexample, a historical picture of specific cloud responses may begenerated and developed.

At process block 508, based upon historical analysis (explained below)and business rules, a cloud control unit (or similar module) may thendetermine the cloud to which to direct the request. At process block510, the response from the cloud for the request is captured by arequest analysis unit (or similar module) and the response is returnedto the user (process block 512). As such, a historical picture of cloudresponsiveness for the application is developed through the followingtwo ways: 1) Actual data—the request analysis unit captures ongoing dataabout the responses from clouds to user requests and develops ahistogram (or the like) to depict overall cloud responsiveness (whichmay be provided to the customer), or 2) Analytics—based upon theactivities carried out in the actual data, the system develops anoverall picture of cloud performance (by day, by time, by geographicrequest, etc.) using a systematic “pinging” of the cloud applicationover a period of time. Thus, the aggregation of these “pings” to theapplication may then be utilized to further shape the data picture ofthe overall responsiveness of a specific cloud.

Furthermore, aspects of the invention also provide customers with theability to specify business rules that determine when and why a requestshould be routed to a specific cloud. These business rules may bedynamically adjusted within parameters (rather than, for example, hardand fast thresholds) based upon analysis provided by the data gatheredfrom actual and analytics data.

Referring next to FIG. 5B a method 501 is illustrated in accordance withembodiments of the present invention. At process block 520, customercloud computing network routing preferences may be received. In oneembodiment, the preferences may include cost, performance, applicationsprovided, network conditions, outages, business relationships, peeringrelationships, proximity, etc. For example, the customer may prefer tooptimize cloud usage to be most cost efficient as possible. As such, theleast expensive cloud computing network may be selected for routingrequests for this particular customer, even at the expense ofperformance. Similarly, if the customer places a high importance onperformance, then cost may be secondary to providing the highest levelof performance. At any rate, the determination of which of the cloudcomputing networks to route requests may be based in whole or in part onthe customer's preferences.

An additional consideration may be driven by providing benefits to thenetwork provider. For example, one or more cloud computing networks maybe underutilized and so requests may be routed to the underutilizedcloud computing networks in order to balance the load among the variousclouds. Furthermore, certain clouds may provide services andapplications and, as such, requests may be directed to the clouds whichalign with the requested service or application.

In addition to the preferences received from the customers, thecustomers may also be able to provide weighting and/or ranking for eachof the preferences (process block 522). For example, the customer mayhave preferences set for cost, performance, and quality of service, andeach of these categories may have a weight associated with it. In oneembodiment, performance may be, for example, weighted at a first valuewhile cost may be weighted at a second (lower) value. Accordingly, whenanalyzing which cloud to route requests, the weights of each preferencesmay guide and direct the decision making process.

Utilizing the preference information and weighting information inconnection with performance data for each of the clouds, a cloudcomputing network routing table (or similar construction) may begenerated (process block 524). Accordingly, in one embodiment, therouting table may be used to provide real-time routing changes anddecisions for directing requests to the most optimal and favorable cloudcomputing networks. The routing table may be dynamically updated aspreferences and weighting change and in response to changes in thenetwork conditions and performance. The cloud and network conditions maybe determined based in part on status requests (pinging, multicast, andthe like) sent to each of the cloud computing networks (process block526). As such, the status for each cloud computing network can beupdated based on the response received form the status requests (processblock 528).

At process block 530, in addition to the performance updates, historicaldata for each cloud may be tracked, analyzed, and stored. Additionally,performance data may also be stored. Such information may be used inconjunction with the real-time status update information, preferences,and rankings to dynamically update the cloud computing network routingtable (process block 532). Therefore, intelligent decision-making withregard to where to route each individual cloud-based application orservice request can be realized.

Referring now to FIG. 5C, a method 503 is illustrated in accordance withembodiments of the present invention. At process block 540, a requestfor cloud-based applications or service may be received at the DNSlevel. In response, the request may be routed to an edge server or thelike (process block 542). At the edge server, the customerrules/policies may be applied to the incoming request (process block544). As such, as discussed above, requests can be routed to apreferential cloud computing network. Accordingly, once an optimal cloudcomputing network is selected, the request is then routed to that cloudcomputing network (process block 546).

At process block 548, a response is received from the cloud computingnetwork. In one embodiment, response time and other metrics may becollected and recorded for assisting in making future routing decisions.Then, the response may be routed back to the edge server and on to therequesting customer (process block 550).

FIG. 5D illustrates a method 505 in accordance with embodiments of thepresent invention. At process block 560, a cloud-based applicationrequest may be received at the edge server. The request may be analyzedwith respect to the cloud computing network routing table and thepolicies associated with the customer originating the request (processblock 562). Accordingly, based on the policies and cloud routing table,a cloud is determined to route the request (process block 564).

At process block 566, performance update and reports may be receivedregarding the request as well as the status of each cloud. In oneembodiment, this information may be used to provide a centralized (orsingle) view for status and performance of each of the cloud computingnetworks. Accordingly, such a user interface may provide a dynamic viewof each cloud's performance, status, applications, and serviceproviders, etc. Accordingly, an administrator may be able to utilizesuch information to make routing decisions in real-time in order toprovide the most optimal cloud-based application and service experience.

Furthermore, based on the updated information for each of the cloudcomputing networks, the routing table may also be updated (process block568). As such, as subsequent requests are received by the edge server,these requests may be routed/re-routed to various clouds to reflect thechanges to performance, cost, etc. of the clouds (process block 570).For example, a cloud based in India may have a higher latency forcustomers in New York than a cloud based in Atlanta. However, because ofcongestion (or other link conditions) the Indian cloud may be able toout-perform the Atlanta cloud despite the latency issues. As such, therouting table would be changed to reflect the change, and requests wouldbe routed accordingly. Similarly, as the Atlanta-based cloud congestionsubsides, the routing table would be updated accordingly, and requestswould then be routed back to the Atlanta-based cloud from theIndian-based cloud, and so forth. Essentially, the dynamic nature of therouting of requests to multiple cloud computing networks for videscustomers with the ability to have requests dynamically routed in themost efficient way possible based on current conditions and preferences.

Turning now to FIGS. 6A and 6B, systems 600 and 601 are illustrated inaccordance with embodiments of the present invention. System 600 mayinclude a user device (or system) 605 in communication with a CDN 610 orPoP 410. The user device 605 is configured to direct cloud-basedapplication requests to the edge server 415 within the CDN 610 or PoP410. The edge server 415 may then direct the requests to a requestanalysis unit 615. In one embodiment, the request analysis unit 615 maybe configured to determine the application or service associated withthe request, the customer associated with the request, etc.

Accordingly, such information about the request may be passed to a cloudcontrol unit 620. The cloud control unit 620 may access a businessrule/policy database 625 to determine the business rules and/or policiesassociated with the originating customer or destination applicationassociated with the request. As discussed above, the customerpreferences may be used to determine which cloud to route variousrequests. For example, a request from customer X for application Y maybe routed differently for requests for application Z, and so forth.Furthermore, the cloud control unit 620 may also access networkperformance conditions for each of the cloud computing networks 630a-630 n. Thus, the cloud control unit 620 may utilize any combination ofthe request characteristics, the link performance conditions, customerpreferences, business rules, policies, etc. to determine which of cloudcomputing networks 630 a-630 n to route each request. Furthermore, asconditions and preferences change, the cloud control unit 620 is able tochange its routing determinations, thus providing a dynamic routing ofrequests to cloud computing networks 630 a-630 n.

Referring first to FIG. 7, a block diagram of an embodiment of a contentdistribution system 700 is shown in which a content originator 710offloads delivery of content objects to a content delivery network(CDN). The content originator 710 produces and/or distributes thecontent objects and may include one or more publishers 706 and contentsites 708. The CDN delivers the content objects over the Internet 704 toend users 722 via corresponding end user devices 720.

As shown, the CDN may include an origin server 712, a policy server 716,and various points of presence (PoPs) 718. PoPs 718 can be deployedthroughout content distribution system 700 and may serve content objectsto end user devices 720 in a particular geographic area and/or inconnection with a particular service provider. For example, a PoP 718may be designated to serve content objects over Internet 704 to endusers 722 in a particular city, on a particular access network, etc. topromote efficient delivery and a good user experience. The various CDNelements may be connected by a private network such as WAN 714 and/or apublic network such as Internet 704.

An end user 722 may browse for content objects at a content site 708with its respective end user device 720. As used herein, a contentobject can be any computer-accessible content and may include audiodata, video data, images, etc. in any number of computer-accessibleformats. The terms content and content object may be usedinterchangeably wherever they appear. End user devices 720 can includepersonal computers, media players, handheld computers, Internetappliances, smart phones, personal digital assistants, streaming radios,or any other device that receives and processes content objects. Thecontent site 708 could be a web page from which content is accessiblevia a web browser.

Links to content at the content site 708 may point to locations in thecontent delivery network. When an end user requests delivery of aparticular content object, the request may be assigned to a PoP 718which, in turn, can deliver the requested content object to the end userdevice 720. If the content object is not available at the assigned PoPlocation, the request may be propagated toward the core of the CDN andmay ultimately be fulfilled from origin server 712. Content may becached at various points between the core CDN and edge locations toimprove efficiency.

Distribution of content objects often represents an important source ofrevenue for publishers 706. For example, content sites 708 may generateadvertising revenue based on the number of times that a content objectis viewed, clicked, or downloaded by end users 722. Thus, to maximizetheir revenue, publishers 706 may seek to reach as many end users 722with their content as possible while providing a good overall userexperience.

Unfortunately, end user devices 720 can vary widely in their respectivecapabilities and the manner in which they interact with content objects.Different end user devices 720 may support different collections ofmultimedia formats and different delivery schemes. For example,beginning with OS version 3.0, the iPhone™ from Apple, Inc. supportsM3U8 playlists and MPEG-2 segmented video with iPhone™ HTTP Streaming(IHS) delivery, entirely over HTTP (Hypertext Transfer Protocol). On theother hand, the Blackberry Storm™ from Research in Motion, Ltd. supportsplayback of multimedia content in Third Generation Partnership Project(3GPP) format, over RTSP (Real-Time Streaming Protocol).

To further complicate matters, the manner in which delivery of a contentobject is initiated may vary from device to device. For example, someend user devices 720 may need help orchestrating a browser-to-player(B2P) handoff for certain types of content objects. Moreover, even whenmedia formats and delivery methods are equally supported, the manner inwhich a content object is delivered may depend on the type of connectionto Internet 704 available to the end user device 720 at a particularplace and time. Thus, for example, the playback capabilities of theBlackberry Storm™ may differ depending upon whether it is connected tothe Internet 704 via a WIFI connection in a cybercafé, or via a cellularnetwork in a remote location.

In the present embodiment, policy server 716 is coupled to content site708 via Internet 704 and receives a notification when new contentobjects are available from publishers 706. Alternatively, a publisher706 may upload its content to an origin server 712 and policy server 716may receive notifications via WAN 714 when a new content object becomesavailable. Although shown separately, policy server 716 may be locatedwithin PoPs 718, origin server 712, or other parts of the contentdelivery network. Also, it will be recognized that the variousoperations of policy server 716 may be carried out by multipleindividual servers such as decisioning servers, merge servers, assemblyservers, etc.

When a new content object is ready for processing, policy server 716determines how it should be made available to end users. This mayinvolve generating a number of different versions of the content objectoptimized for use with different end user devices 720, having differentcapabilities, and potentially used in different network environments.The different versions of the content object may correspond to differentproduction or encoding profiles maintained at policy server 716. Theproduction profiles, in turn, may be based upon a publisher'srequirements for the distribution of its content objects. For example, apublisher may prefer to distribute its content in a specific mediaformat or formats, to exploit device-specific capabilities (such as IHSstreaming for iPhones), to optimize separately for high bitrate and lowbitrate environments, to target specific operating systems and/orplatforms such as Windows™ or Mac OS, etc.

Policy server 716 may associate the different versions of a contentobject with a single network identifier such as a uniform resourcelocator (URL). The single network identifier can then be returned to thepublisher 706 which created the content. The publisher 706 can add thenetwork identifier to one or more content sites 708 which are accessibleto end users 722. When a request for the content object is received froman end user device 720, it can be sent to policy server 716 foranalysis. Using all available information, policy server 716 candetermine a preferred version of the content object for the end userdevice 720 and can orchestrate its delivery to the requesting end user.The preferred version and delivery method can be customized for hardwareand software capabilities of the end user device 720, bandwidth andconnection quality, viewing habits, user preferences, or any combinationof factors. The preferred version may also include a selection ofadvertisements which are matched to information about the end userdevice and/or the end user.

As described herein, policy server 716 provides publishers 706 with aone-to-many approach to optimized content delivery. Specifically, asingle network identifier can point to multiple versions of a givencontent object from which policy server 716 selects a preferred versionfor use with a particular end user device. Policy server 716 thusrelieves publishers 706 of the burden of staying up-to-date withtechnology. When a new platform emerges or device capabilities change,appropriate versions of the content object can be made available to endusers 722 through an existing network identifier without further effortfrom the publisher 706. Policy server 716 determines the preferredversion of a content object in a manner that is transparent to the enduser and thus avoids complicated configuration, specialized software, ormanual selection. The end user experience is further improved byselecting a delivery method and sending the preferred version of thecontent object from a PoP 718 location with a fast response time for theuser's location, network access, etc.

FIG. 8 provides a schematic illustration of one embodiment of a computersystem 800 that can perform the methods of the invention, as describedherein. It should be noted that FIG. 8 is meant only to provide ageneralized illustration of various components, any or all of which maybe utilized as appropriate. FIG. 8, therefore, broadly illustrates howindividual system elements may be implemented in a relatively separatedor relatively more integrated manner.

The computer system 800 is shown comprising hardware elements that canbe electrically coupled via a bus 805 (or may otherwise be incommunication, as appropriate). The hardware elements can include one ormore processors 810, including without limitation, one or more generalpurpose processors and/or one or more special purpose processors (suchas digital signal processing chips, graphics acceleration chips, and/orthe like); one or more input devices 815, which can include withoutlimitation a mouse, a keyboard and/or the like; and one or more outputdevices 820, which can include without limitation a display device, aprinter and/or the like.

The computer system 800 may further include (and/or be in communicationwith) one or more storage devices 825, which can comprise, withoutlimitation, local and/or network accessible storage and/or can include,without limitation, a disk drive, a drive array, an optical storagedevice, a solid state storage device such as a random access memory(“RAM”) and/or a read-only memory (“ROM”), which can be programmable,flash updateable and/or the like. The computer system 800 might alsoinclude a communications subsystem 830, which can include withoutlimitation a modem, a network card (wireless or wired), an infraredcommunication device, a wireless communication device and/or chipset(such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMaxdevice, cellular communication facilities, etc.), and/or the like. Thecommunications subsystem 830 may permit data to be exchanged with anetwork (such as the network described below, to name one example),and/or any other devices described herein. In many embodiments, thecomputer system 800 will further comprise a working memory 835, whichcan include a RAM or ROM device, as described above.

The computer system 800 also can comprise software elements, shown asbeing currently located within the working memory 835, including anoperating system 840 and/or other code, such as one or more applicationprograms 845, which may comprise computer programs of the invention,and/or may be designed to implement methods of the invention and/orconfigure systems of the invention, as described herein. Merely by wayof example, one or more procedures described with respect to themethod(s) discussed above might be implemented as code and/orinstructions executable by a computer (and/or a processor within acomputer). A set of these instructions and/or codes might be stored on acomputer-readable storage medium, such as the storage device(s) 825described above. In some cases, the storage medium might be incorporatedwithin a computer system, such as the system 800. In other embodiments,the storage medium might be separate from a computer system (i.e., aremovable medium, such as a compact disc, etc.), and is provided in aninstallation package, such that the storage medium can be used toprogram a general purpose computer with the instructions/code storedthereon. These instructions might take the form of executable code,which is executable by the computer system 800 and/or might take theform of source and/or installable code, which, upon compilation and/orinstallation on the computer system 800 (e.g., using any of a variety ofgenerally available compilers, installation programs,compression/decompression utilities, etc.), then takes the form ofexecutable code. In one embodiment, the computer or machine-readablemedium may be non-transitory.

It will be apparent to those skilled in the art that substantialvariations may be made in accordance with specific requirements. Forexample, customized hardware might also be used, and/or particularelements might be implemented in hardware, software (including portablesoftware, such as applets, etc.), or both. Further, connection to othercomputing devices such as network input/output devices may be employed.

In one aspect, the invention employs a computer system (such as thecomputer system 800) to perform methods of the invention. According to aset of embodiments, some or all of the procedures of such methods areperformed by the computer system 800 in response to processor 810executing one or more sequences of one or more instructions (which mightbe incorporated into the operating system 840 and/or other code, such asan application program 845) contained in the working memory 835. Suchinstructions may be read into the working memory 835 from anothermachine-readable medium, such as one or more of the storage device(s)825. Merely by way of example, execution of the sequences ofinstructions contained in the working memory 835 might cause theprocessor(s) 810 to perform one or more procedures of the methodsdescribed herein.

The terms “machine-readable medium” and “computer readable medium,” asused herein, refer to any medium that participates in providing datathat causes a machine to operate in a specific fashion. In an embodimentimplemented using the computer system 800, various machine-readablemedia might be involved in providing instructions/code to processor(s)810 for execution and/or might be used to store and/or carry suchinstructions/code (e.g., as signals). In many implementations, acomputer-readable medium is a physical and/or tangible storage medium.Such a medium may take many forms, including but not limited to,non-volatile media, volatile media, and transmission media. Non-volatilemedia includes, for example, optical or magnetic disks, such as thestorage device(s) 825. Volatile media includes, without limitation,dynamic memory, such as the working memory 835. Transmission mediaincludes coaxial cables, copper wire and fiber optics, including thewires that comprise the bus 805, as well as the various components ofthe communications subsystem 830 (and/or the media by which thecommunications subsystem 830 provides communication with other devices).Hence, transmission media can also take the form of waves (includingwithout limitation radio, acoustic and/or light waves, such as thosegenerated during radio wave and infrared data communications).

Common forms of physical and/or tangible computer-readable mediainclude, for example, a floppy disk, a flexible disk, a hard disk,magnetic tape, or any other magnetic medium, a CD-ROM, any other opticalmedium, punchcards, papertape, any other physical medium with patternsof holes, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other memory chipor cartridge, a carrier wave as described hereinafter, or any othermedium from which a computer can read instructions and/or code.

Various forms of machine-readable media may be involved in carrying oneor more sequences of one or more instructions to the processor(s) 810for execution. Merely by way of example, the instructions may initiallybe carried on a magnetic disk and/or optical disc of a remote computer.A remote computer might load the instructions into its dynamic memoryand send the instructions as signals over a transmission medium to bereceived and/or executed by the computer system 800. These signals,which might be in the form of electromagnetic signals, acoustic signals,optical signals and/or the like, are all examples of carrier waves onwhich instructions can be encoded, in accordance with variousembodiments of the invention.

The communications subsystem 830 (and/or components thereof) generallywill receive the signals, and the bus 805 then might carry the signals(and/or the data, instructions, etc., carried by the signals) to theworking memory 835, from which the processor(s) 810 retrieves andexecutes the instructions. The instructions received by the workingmemory 835 may optionally be stored on a storage device 825 eitherbefore or after execution by the processor(s) 810.

As will be understood by those skilled in the art, the present inventionmay be embodied in other specific forms. In one particular embodiment ofthe partial object cache, as previously described, can be associatedwith a plurality of versions of programming structures. Those skilled inthe art will recognize, or be able to ascertain using no more thanroutine experimentation, many equivalents to the specific embodiments ofthe invention described herein. Such equivalents are intended to beencompassed by the following claims.

What is claimed is:
 1. A method of implementing edge-based cloudcomputing including an edge server that communicates with end users andarranges application resources, the method comprising: determining anedge server from a plurality of geographically distributed edge serverswithin a cloud to use to communicate with a user device based on anefficiency threshold, wherein a content delivery network comprises theplurality of geographically distributed edge servers; receiving, at thedetermined edge server, an application service request from a userdevice; analyzing the application service request to gather metricsabout historical responses provided by applications in each of aplurality of clouds; based on the gathered metrics, determining a cloudof the plurality of clouds to which to direct the application servicerequest; forwarding the application service request to a computeplatform in the determined cloud; capturing a response to theapplication service request from the determined cloud; and responding tothe application service request.
 2. The method of implementingedge-based cloud including the edge server that communicates with endusers and arranges application resources computing of claim 1, whereinthe cloud is also determined based on a business rule.
 3. The method ofimplementing edge-based cloud including the edge server thatcommunicates with end users and arranges application resources computingof claim 1, wherein the historical responses include responses to pastapplication service requests from user devices.
 4. The method ofimplementing edge-based cloud computing including the edge server thatcommunicates with end users and arranges application resources of claim1, wherein the historical responses include historical responses topings.
 5. The method of implementing edge-based cloud computingincluding the edge server that communicates with end users and arrangesapplication resources of claim 1, further comprising updating orgenerating a cloud routing table based on the gathered metrics, whereinthe cloud is determined in accordance with routing in the cloud routingtable.
 6. The method of implementing edge-based cloud computingincluding the edge server that communicates with end users and arrangesapplication resources of claim 5, wherein the routing in the cloudrouting table further depends on preferences of a customer.
 7. Themethod of implementing edge-based cloud computing including the edgeserver that communicates with end users and arranges applicationresources of claim 1, wherein the efficiency threshold comprises alatency value between the user device and the edge server.
 8. Acomputer-readable memory having sets of instructions stored thereonwhich, when executed by a computer, cause the computer to: determine anedge server from a plurality of geographically distributed edge serverswithin a cloud to use to communicate with a user device based on anefficiency threshold, wherein a content delivery network comprises theplurality of geographically distributed edge servers; receive, at thedetermined edge server, an application service request from a userdevice; analyze the application service request to gather metrics abouthistorical responses provided by applications in each of a plurality ofclouds; based on the gathered metrics, determine a cloud of theplurality of clouds to which to direct the application service request;forward the application service request to a compute platform in thedetermined cloud; capture a response to the application service requestfrom the determined cloud; and respond to the application servicerequest.
 9. The computer-readable memory of claim 8, wherein the cloudis also determined based on a business rule.
 10. The computer-readablememory of claim 8, wherein the historical responses include responses topast application service requests from user devices.
 11. Thecomputer-readable memory of claim 8, wherein the historical responsesinclude historical responses to pings.
 12. The computer-readable memoryof claim 8, wherein the instructions, when executed by the computer,further cause the computer to update or generate a cloud routing tablebased on the gathered metrics, wherein the cloud is determined inaccordance with routing in the cloud routing table.
 13. Thecomputer-readable memory of claim 12, wherein the routing in the cloudrouting table further depends on preferences of a customer.
 14. Thecomputer-readable memory of claim 8, wherein the efficiency thresholdcomprises a latency value between the user device and the edge server.15. A system for implementing edge-based cloud computing including anedge server that communicates with end users and arranges applicationresources, the system comprising: an edge server configured to receivean application service request from a user device, the edge server beingof a plurality of geographically distributed edge servers within acloud, a content delivery network comprising the plurality ofgeographically distributed edge servers, the edge server being selectedfrom amongst the plurality of edge servers based on an efficiencythreshold; a cloud control unit configured to: analyze an applicationservice request received at the edge server from a user device to gathermetrics about historical responses provided by applications in each of aplurality of clouds; based on the gathered metrics, determine a cloud ofthe plurality of clouds to which to direct the application servicerequest; forward the application service request to a compute platformin the determined cloud; and capture a response to the applicationservice request from the determined cloud.
 16. The system forimplementing edge-based cloud computing including the edge server thatcommunicates with end users and arranges application resources as inclaim 15, wherein the edge server and the cloud control unit are withina single point of presence (PoP) in the content delivery network, thecontent delivery network comprising a plurality of points of presence.17. The system for implementing edge-based cloud computing including theedge server that communicates with end users and arranges applicationresources as in claim 15, further comprising a request analysis unitthat determines an application or service associated with the request,wherein the cloud control unit accesses a policy associated with theapplication or service, and wherein the cloud is determined at least inpart based on the policy.
 18. The system for implementing edge-basedcloud computing including the edge server that communicates with endusers and arranges application resources as in claim 15, furthercomprising a request analysis unit that determines a customer associatedwith the request, wherein the cloud control unit accesses a policyassociated with customer, and wherein the cloud is determined at leastin part based on the policy.
 19. The system for implementing edge-basedcloud computing including the edge server that communicates with endusers and arranges application resources as in claim 15, wherein thehistorical responses include responses to past application servicerequests from user devices.
 20. The system for implementing edge-basedcloud computing including the edge server that communicates with endusers and arranges application resources as in claim 15, wherein thehistorical responses include historical responses to pings.